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Abstract 

Background: Mobile health (mHealth) has undergone exponential growth in recent years. Patients and healthcare 
professionals are increasingly using health-related applications, at the same time as concerns about ethical issues, bias, 
conflicts of interest and privacy are emerging. The general aim of this paper is to provide an overview of the current state of 
development of mHealth. 

Methods and Findings:^ o exemplify the issues, we made a systematic review of the pain-related apps available in scientific 
databases (Medline, Web of Science, Gale, Psycinfo, etc.) and the main application shops (App Store, Blackberry App World, 
Google Play, Nokia Store and Windows Phone Store). Only applications (designed for both patients and clinicians) focused 
on pain education, assessment and treatment were included. Of the 47 papers published on 34 apps in scientific databases, 
none were available in the app shops. A total of 283 pain-related apps were found in the five shops searched, but no articles 
have been published on these apps. The main limitation of this review is that we did not look at all stores in all countries. 

Conclusions: There is a huge gap between the scientific and commercial faces of mHealth. Specific efforts are needed to 
facilitate knowledge translation and regulate commercial health-related apps. 
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Introduction 

Healthcare systems worldwide are becoming exhausted; many 
demands are placed on them but resources are scarce. Healthcare 
costs are escalating and our public health systems seem to be 
incapable of satisfying the needs of a fast growing population [1]. 
In this scenario, what is known as mobile health technology or 
"mHealth" - that is, healthcare supported by mobile communi- 
cation technologies - has undergone exponential growth in the last 
few years. 

Mobile health technology can make healthcare more accessible 
and affordable for all. It has proven to be a good way of delivering 
high-quality healthcare services to a variety of patient populations, 
particularly those with low incomes [2] and in remote places (far 
from reference centers) [3]. mHealth technology has also proven 
to be highly suitable for young people (and also very popular) [4] 
as they spend more time using electronic media than doing any 
other activity besides sleeping [5]. 

It has been estimated that by the end of 2016, there will be ten 
billion mobile devices in use around the world [3]. Patients and 
healthcare professionals are increasingly using health-related 
applications [6]. To date, more than 97,000 of these applications 
have been developed and in the next few years more than three 
million free and 300,000 paid downloads are expected to be made 
of mHealth applications just in the USA [7]. A recent study 



concluded that the Smartphone is the most popular technology 
among physicians since the stethoscope [1]. Furthermore, mobile 
phone use seems to be greater among those populations most in 
need of such interventions [8]. mHealth seems to be a logical, 
acceptable, and affordable way to extend and improve health care. 

Although the progress of mHealth has many advantages, some 
of which have been summarized above, this extremely fast growth 
also has a negative side: namely, most of the procedures available 
have not been subject to a thorough assessment and validation 
[9,10]. Explicit and sensible concerns about ethical issues, bias, 
conflicts of interest [11], and security and privacy problems [2] 
have been raised in the specialized literature. 

Some action protocols and strategies are being developed to 
deal with these as yet unsolved issues in Europe [12,13] and the 
USA [14,15]. For example, the World Health Organization in 
partnership with the United Nations specialized agency for 
information and communication technologies has developed an 
initiative regarding the management of Non-Communicable 
Diseases using mHealth [16]. Also, some charities, and not-for- 
profit or private organizations have launched initiatives to boost 
the potentialities of mHealth. This is the case, for example, of the 
mHealth Alliance, hosted by the United Nations Foundation [17]. 
Similarly, PatientView has recently released the web page 
"myhealthapps.net", recommended by the Directorate General 
for Communications Networks, Content and Technology of the 
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European Commission. This web page is an evolution of the 
previously published "European Directory of Health Apps" [18], 
in which patients' associations from all over the world used a zero- 
to-five Likert-type scale to rate 307 health-related apps on the 
extent to which they help control their condition, keep them 
healthy, are trustworthy, are easy to use, allow them to network 
with people like them/who understand them, and can be used 
regularly. In the context in which we find ourselves, then, 
commercial apps are developing exponentially, while mHealth- 
related scientific publications are also growing. However, it is not 
clear that both worlds interact and, if they do, how. That is to say, 
is the growth rampant, or is there fruitful interaction between the 
two worlds? Are research findings translated and used to improve 
the apps that are created or are knowledge transfer processes 
failing? 

In this situation, it would be extremely useful if a review were to 
map out the terrain, identify problems and tentatively suggest 
avenues for improvement. 

However, the field of mHealth is so wide that a complete review 
and analysis cannot be contemplated. Therefore, we decided to 
focus on pain-related apps as a way of managing an otherwise 
insurmountable amount of information. First, although mHealth 
uses various alternatives and technologies to educate patients, and 
to prevent and/ or treat illness, apps are at the heart of the process. 
Two specific features of apps make it particularly important for 
their quality and scientific rigor to be studied: namely, (1) the app 
is available to consumers who do not have a professional to 
recommend, prescribe or even monitor how they use it, and (2) too 
often there is nobody "responsible" and available if the app is not 
working as expected or if something goes wrong. Second, we 
decided to concentrate on pain-related apps because pain is one of 
the most generalized symptoms of chronic health conditions [19]. 
It is a ubiquitous health problem, and well suited to be assessed 
and managed with these mHealth interventions [20-22]. So it can 
be readily used to explore and exemplify the issues when looking 
into the current state of development of mHealth. 

The general aim of this paper is to provide an overview of the 
current state of development of mHealth. In order to do so, and to 
exemplify the issues, we conducted a systematic review of the pain- 
related apps available and reported on their characteristics; we 
looked both at the commercial and the scientific aspects of this 
development. The specific objectives of our review are to: (1) 
detect the number of pain-related apps reported in scientific 
databases, (2) find out which ones are available at the stores for 
general consumers, (3) identify which pain-related apps are 
available at the main apps shops, (4) find out which of these apps 
are scientifically supported, and (5) uncover any other additional 
support that the apps may have. 

Our specific hypotheses were that (1) only a few of the apps 
reported in peer-reviewed publications are available to the 
consumer, and (2) of the apps available in the shops, very few 
have a scientific base. 

Methods 

Phase I: what can be found in scientific databases? 

Search strategy and selection criteria. Preferred Report- 
ing Items for Systematic Reviews and Meta-Analyses (PRISMA) 
guidelines [23] were followed. Data for this review were identified 
by searches of following scientific databases: Medline (National 
Library of Medicine), Science Citation Index Expanded (Web of 
Science), Health Reference Center Academic (Gale), Wiley Online 
Library, American Psychological Association (Psycinfo), SciVerse 
ScienceDirect (Elsevier), SpringerLink, Wolters Kluwer - Ovid - 



Lippincott Williams & Wilkins (CrossRef), Directory of Open 
Access Journals (DOAJ), Social Sciences Citation Index (Web of 
Science), Taylor & Francis Online - Journals, Expert Reviews 
(Future Science), Informa - Informa Healthcare (CrossRef), 
SpringerLink Open Access, Wolters Kluwer - Ovid (CrossRef), 
BMJ Journals, DiVA - Academic Archive Online, Informa 
(CrossRef), and references from relevant articles using the search 
terms (Pain OR *ache) AND (Smartphone OR app OR 
application OR electronic OR "Personal Digital Assistant" OR 
PDA). Only peer-reviewed articles published in English or Spanish 
between 1996 (the release date of the first palmtop computer [24]) 
and December 2013 were included. 

Phase II: what scientifically assessed pain-related apps are 
available in the stores? 

The name of each app retrieved in phase I was searched for in 
each of the following shops: App Store (iPhone), Blackberry App 
World, Google Play (Android), Nokia Store and Windows Phone 
Store. 

Phase III: what can be found in the stores? 

In December 2013, the main Smartphone application shops 
were reviewed: App Store (iPhone), Blackberry App World, 
Google Play (Android), Nokia Store and Windows Phone Store. 
The review was conducted in the following countries: Canada, 
Spain, and USA. The search terms were: "Pain", "*ache" and 
"dolor". The applications (designed for both patients and 
clinicians) focused on pain education, assessment and treatment 
were included. 

Phase IV: what support do the apps available in stores 
have? 

A step-by-step sequential strategy was followed to assess the 
quality of the apps found in phase III. First, the name of each app 
was searched for in the same databases as in Phase I. Then, the 
web page "myhealthapps.net" was also reviewed. All the pain- 
related apps were recorded. Finally, the name of each app was 
Google searched for such information as whether the developers 
had a webpage, which research centers used the app, who its 
creators were and/or the results it had provided, etc. This 
information was compared with the information obtained in phase 
I to see if the authors of the apps were the same as the authors of 
the publications. 

Results 

Phase I: what can be found in scientific databases? 

After reviewing the databases, we found 47 papers reporting on 
34 pain-related apps. Figure 1 describes our study's selection 
process. 

As can be seen in Table 1, all apps are related to assessment, 
and almost all are available in English (26, 76.5%) and address 
non-specific chronic pain problems (28, 82.4%). About two-thirds 
are designed for adults (22, 64.7%). 

Phase II: are the scientifically assessed apps available in 
the stores? 

No pain-related app reported in any paper found during Phase I 
was available in any of the five main shops for the general public. 
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Records identified through 
database searching 
(n = 1095) 



Additional records identified 
through reference lists 
(n = 9) 



Total records 
(n = 1104) 



Duplicates removed 
(n = 263) 



Records screened 
(n = 841) 



Full-text articles assessed 
for eligibility 
(n = 85) 



Studies included in 
qualitative synthesis 
(n = 47) 



Records excluded 
(n = 756) 

APP protein 

Electronic medical records 
Application of treatments 



Full-text articles excluded 
(n = 38) 

Desktop or laptop computer apps 
Datalogger programmes 
Ongoing clinical trials 
Comments 
Reviews 

Conference proceedings 
Written in German 



Figure 1. Flow chart of our systematic review selection process. 

doi:1 0.1 371 /journal.pone.01 01 31 2.g001 



Phase III: what can be found in the stores? 

A total of 283 pain-related apps were found in the five shops 
searched. Because of word count and space limitations, the full list 
is provided as an annex to the article (see Table SI). 

Phase IV: what type of support do the pain-related apps 
available in stores have? 

When we searched for these 283 apps in the scientific databases, 
we did not find a single article that was related to them in any way. 
Therefore, this search found no evidence of scientific support for 
the 283 pain-related apps. Nevertheless, some apps do have other 
support types. Figure 2 describes our app selection process. 

A full description of 40 apps - including name, developers, 
supports, pain problem it addresses, features, platform, price, 
language/ s and user ratings - is provided as an annex to the article 
(see Table S2). Figure 3 summarizes the type of support that the 
pain-related apps have. 

Most of the apps are available in English (36, 90%), and have 
been developed in the USA (16, 40%), the EU (15, 37.5%), or 
Canada (6, 15%). The App Store and Google Play are the most 
important platforms, hosting 39 (97.5%) of the supported apps. 
The most important sources of support to these apps are: having a 
licensed professional as a creator (24, 62.5%) or being recom- 
mended by a patient association (12, 30%). "Pain in general" (9, 
22-5%), Mowed by back pain (8, 20%), headache (7, 17.5%) and 
arthritis (6, 15%), are the types of pain that these apps are most 
commonly designed for. As far as the targeted consumers are 
concerned, most of the apps are addressed to patients (28, 70%) 
and only a few have been developed for healthcare professionals 



(5, 12.5%) or both audiences (7, 17.5%). Most patient-oriented 
apps provide information about the pain problem/illness and ways 
to check symptoms and track medication consumption. Only a few 
provide information about alternative ways of coping with the 
health problem either through videos or written instructions, for 
example, about exercising, massage, or even hypnosis. Profession- 
al-oriented apps provide support for diagnosis, medication dose 
calculation, or self-report questionnaires. All patient-oriented 
applications are classified as +4 years or "low maturity", while 
professional-oriented are classified as +17 years. 

None of the authors /developers of the apps were found to be 
the authors of articles about them. 

Discussion 

Overall, this review indicates that the commercial and scientific 
sides of the mHealth coin do not interact properly. We found that 
pain-related apps that have been reported in scientific journals 
have not yet made their way into the shops and are therefore 
unavailable to clinicians and/or patients. Conversely, 283 pain- 
related apps were available in the main shops, but none of them 
had been scientifically validated or proven to be effective. These 
findings are in line with our hypotheses but the situation is even 
more extreme than we had imagined. However, it may be just a 
matter of time before this state of affairs changes because some 
apps are currendy in the last stages of the knowledge translation 
process. For example, Painometer V2, an app developed to help with 
the assessment of pain intensity is already available in Google Play 
and has shown some evidence of usability [72,73] and of the 
psychometric properties of the scales contained [74]. Pain Squad is 
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another app that has already reported information on usability, 
feasibility, and compliance [47,48]. It is currently available in four 
Canadian hospitals and may be available soon at the App Store 
[75]. 

mHealth technologies have numerous important advantages 
over other more traditional alternatives. For example, they capture 
time- and date-stamped information, and provide detailed and 
non-biased information on such fundamental health-related 
variables as physical activity or physiological responses, thus 
reducing memory bias. They can also be extremely useful in public 
health actions (for example, by providing routes to help patients 
who have to take medications on a specific schedule) and help us 
reach underserved populations, those that are most in need of 
health care support. 

In the midst of this huge, positive development there are some 
fundamental concerns that require appropriate responses. For 
example, issues of confidentiality or the protection of patients' 
personal data still have to be dealt with. Furthermore, some apps 
occupy a "legal void". For example, electronic diaries or cognitive- 
behavioral treatments for health conditions are unregulated, a 
situation that needs to be remedied. Overall, the results of this 
review indicate that consumers run some risks above and beyond 
paying for a potentially useless app. For example, we found some 
apps that claimed they could heal the body by emitting vibrations, 
"brain waves", or accessing the subconscious to "tell the body to 
heal". These unproven claims may lead patients to a feeling of 
helplessness and lack of control about their illnesses. 

As mentioned above, there is a gap between the scientific and 
the commercial sides of the mHealth coin. Significant develop- 
ments have been made in both areas but they remain essentially 
disconnected, advancing in parallel with no significant interaction. 
None of the apps in the shops have proved to have scientific 
support and only a fifth (57, 40+17 versions for other platforms, 
20. 1 %) of them have some type of support. Some scientifically 
developed apps look promising but there is an urgent need to 
promote actions for knowledge translation in this field. Other 
researchers have found similar results when looking into other 
mHealth areas: apps to manage diabetes [76] and the world 
deadliest diseases [77]. They both found that the commercial area 
was significantly more developed than the research field. Referring 
to cardiology apps [78], they found that most of the published 
papers reviewed monitoring apps, but similarly to our findings, the 
majority was not smartphone apps themselves but computers apps 
that could be also used by a mobile phone or a smartphone. 

In the near future, perhaps, physicians will be prescribing 
specific applications to specific patients for specific problems [79] 
(very much like today when they electronically prescribe medica- 
tions, or work with the patient's electronic clinical history system 
and health records). It does not make much sense for drugs to have 
to go through a long and complex process between the discovery 
of the active ingredient and being put on the market, while apps 
do not have to fulfill any requirements at all, not even show that 
they are effective and safe. There may be no need for health- 
related apps to go to the extremes of approved drugs, but a 
minimum level of quality should be compulsory. Health-related 
apps can also have negative effects. Therefore, we should be able 
to regulate what is available in stores, and prevent unregulated 
apps from being published in the field of health (health-related 
apps should inform about quality controls and prove they are 
efficacious before they can use the adjective health, in the same 
way that current laws prevent food from bearing the name "bio" if 
their real properties have not been subject to strict analysis). 
Furthermore, lists of approved health-related apps ought to be 
published and the general public informed, for example, through 
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Apps identified through shop 
searching 
(n = 1952) 
App Store = 155 
Blackberry App World = 77 
Google Play = 1492 
Nokia store = 157 
Windows Phone Store = 71 



Apps excluded 
(n = 1669) 

Games 

Songs 

e-books 

Journal apps 

Medical center apps 

Doctor finders 

Not Pain-related 



Unsupported apps 
(n = 243) 



I 

Supported apps 

(n = 40*) 
App Store = 28 
Blackberry App World = 1 

Google Play = 25 
Windows Phone Store = 1 



Pain-related apps 




(n = 283) 




App Store = 82 




Blackberry App World = 22 


► 


Google Play = 152 




Nokia store = 8 




Windows Phone Store = 19 





* 16 of the 40 apps have an Android and iPhone version; one has a Blackberry and iPhone version. 

Figure 2. Flow chart of pain-related apps selection process. 

doi:1 0.1 371 /journal.pone.01 01 31 2.g002 



an app-related vade-mecum, so that both health experts and 
patients can make informed decisions about whether to use certain 
apps. A promising avenue that would prove fruitful in the near 
future is the work done by Public Agencies in the field of quality 
distinctions, for example, the "AppSaludable Distinctive", reported 
in the last European Journal of e-practice [80] To date, and to the 
best of our knowledge, no pain-related app has been awarded this 
quality stamp and just one (Painometer v2) has applied for it [81]. 

Perhaps the most important limitation of this review is that we 
did not look at all stores in all countries. We selected three of the 
possibilities, not only because it was convenient, but also because it 
was what could be feasibly done. Our hypothesis is that if we had 
conducted specific reviews for the 97,000 health-related apps 
available worldwide, results would not have been much different, 
particularly considering that we explored the most important app 
stores and that other researchers [76-78] found similar results. 

All the articles reviewed were related to pain assessment, with 
some dealing with educational issues. Future studies are needed in 
the area of pain management. We are aware that some research 
groups are working on this subject, so we can expect developments 
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in the future. Most apps are designed for adults or adolescents, but 
there are very few for children. However, children are using these 
technologies at a very early age: 72% of children younger than 
eight years old use mobile devices and 50% of those use apps [82]. 
Therefore, additional research is greatly needed in this area if 
health-related apps are to be developed that are efficacious and 
developmentally appropriate. 
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